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Abstract 

We consider the time-inhomogeneous Markovian jump process introduced by 
John S. Bell [I] for a lattice quantum field theory, which runs on the associated 
configuration space. Its jump rates, tailored to give the process the quantum 
distribution 2 at all times t, typically exhibit singularities. We establish the 
existence of a unique such process for all times, under suitable assumptions on 
the Hamiltonian or the initial state vector ^o- The proof of non-explosion takes 
advantage of the special role of the \^t\ 2 distribution. 
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1 Introduction 

This paper deals with the existence of Markov jump processes on countable sets having 
time-inhomogeneous transition rates of a particular form proposed by John S. Bell [3] 
in his observer-independent formulation of lattice quantum field theories. Bell's setting 
is as follows. 

Bell's model. Let E be the configuration space for a variable but finite number of 
particles on a countable lattice ACM 3 . A configuration x G E is mathematically 
represented by a function x : A — > Z + := {0, 1,2,.. .} indicating the number of particles 
x(r) at a site re A. Thus 

E = IxeZ^: x(r) < oo). 
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Hence E is countably infinite. (In Bell's proposal, x(r) is the number of fermions at 
site r, but this is of no relevance here.) 

Next, Bell considers the Hilbert space M' and the Hamiltonian if of a lattice quan- 
tum field theory. This means that if is a self-adjoint operator on Jrf? determining the 
quantum state at time t via 

q t=e -im/h^ o ^ 

for some initial state vector \l/ . These quantities are related to the configuration space 
by a projection-valued measure (PVM) P on E acting on M' . That is, for every x e E 
there exists an associated projection P(x) such that YlxeE P( x ) — !■> where i is the 
identity operator, and P(x)P(y) = when x ^ y. Specifically, P(x) is the projection 
to the joint eigenspace of the (commuting) fermion number operators N(r) associated 
with the eigenvalues x{r). In particular, {^ t \P(x)^/ t ) is the quantum probability of a 
configuration x at time t. Bell then introduces the transition rate 

for a jump from x to y G E, where a + = max(a, 0) denotes the positive part of a. Note 
that a t (x\x) = because (^ t \P(x)HP(x)^ t ) = (P(x)^ t \HP(x)^ t ) is real. A formal 
calculation yields that this choice of the jump rates is compatible with the process having 
distribution (\l/ t |P( • at each time t. See ^7] for an extensive discussion of this jump 
rate formula. In this paper we will choose the time unit such that h = 2. 

Probabilistic questions. One of the main features of the transition rates (j2J) is that they 
become singular at times t when x becomes a "node" of ty t > i-e., when the denominator 
(ty t \P(x)^ t ) in © vanishes. So, at such times the process would not know how to 
proceed. Fortunately, it turns out that the increase of the rates close to such singularities 
has the positive effect of forcing the process to jump away before the singularity time is 
reached. 

A more serious problem is the possibility of explosion in finite time; that is, the 
jump times T n could accumulate so that ( = sup n T n < oo with positive probability. 
The standard criteria for non-explosion of pure jump processes are confined to transition 
rates that are homogeneous in time, relying heavily on the fact that the holding times 
are then exponentially distributed and independent; see, e.g., Section 2.7 of |2I] or 
Proposition 10.21 of [T^j. This independence, however, fails to hold in the case of time- 
dependent jump rates, and the singularities of Bell's transition rates do not allow any 
simple bounds excluding explosion. The only thing one knows is that the process is 
designed to have the prescribed quantum distribution at fixed (deterministic) times, 
and it is this fact we will exploit. 

Our proof will not make any use of the particular construction or meaning of E and 
P. We will merely assume that E is a countable set and P a PVM on E acting on 
'. Actually we only need that P is a positive-operator- valued measure; see Section |U 
below. Steps towards an existence proof for Bell's process have already been made by 
Bacciagaluppi PQ |2] ; his approach is, however, very different from ours. 
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Physical Perspective. Bell's observer-independent formulation of lattice quantum field 
theories has attracted increasing attention recently [TTJ H2J EH EH EE HZ] • Apart from 
its relevance to the foundations of quantum theory, it has proven useful for numerical 
simulations [13], and has been found distinguished among all |\1/| 2 distributed processes 
as the minimal one jTTl E3] , involving the least amount of stochasticity. 

There are close connections between Bell's model and two well-known |\1/| 2 dis- 
tributed processes associated with nonrelativistic quantum mechanics in M 3 : E. Nelson's 
stochastic mechanics UH1 El El and Bohmian mechanics El El E] • These processes 
are similar in spirit to Bell's process, and can be combined with Bell's stochastic jumps 
to include particle creation and annihilation ^SJEIIlEl- Bell's process has also been 
utilized for modal interpretations of quantum theory j2j. Bohmian mechanics arises as 
the continuum limit of Bell's process for a suitable choice of H and E |2bl 127] , and in 
general the continuum limit presumably resembles the combined Bell-Bohm model of 
|16j . A generalization of Bell's jump rate (0) to continuum spaces E is given in |17j . 
The global existence problem of stochastic mechanics has been solved in [S] (see also 
EH]) and the one of Bohmian mechanics in j^j, whereas for combined models with 
jumps, such as the ones considered in [HHHT.], it is still open. The existence problems 
of stochastic mechanics and Bohmian mechanics have two aspects in common with that 
of Bell's process: First, since the law of motion (as defined by the drift in stochastic 
mechanics, the velocity in Bohmian mechanics, and the jump rate in Bell's model) is 
ill-defined at the nodes of the wave function, one needs to show that the process never 
reaches a node. Second, while in stochastic mechanics and Bohmian mechanics there are 
no jumps that could accumulate, one needs to exclude (and has excluded) the analogous 
possibility that the process could escape to infinity in finite time. 

2 The Result 

The basic ingredients of the model are: 

- a complex Hilbert space Jif with inner product ( ■ | • ), the space of quantum states, 

- a self-adjoint operator H acting on , the Hamiltonian, 

- an initial state vector \l/ £ ^ with H^oll = 1, 

- a countable set E, physically thought of as configuration space and serving as state 
space of the jump process to be constructed, and 

- a positive-operator-valued measure (POVM) P( ■ ) on E acting on Jff. 

Here, a POVM is a family (P(x)) x( ze of positive bounded self-adjoint operators on Jrf? 
such that, for each F C E, the sum P(F) := ^2 xeF P(x) exists in the sense of the weak 
operator topology, and P(E) = L In fact, the countable additivity then also holds in 
the strong topology [12]. In particular, 

V $ G J$? : ^^P(x)$ converges in the L 2 sense to $. (3) 



3 



Every PVM is a POVM but not vice versa. As has already been pointed out in J7|, the 
jump rate formula (J2J) still makes sense if P( • ) is a POVM rather than a PVM. 

In quantum field theory, the "configuration observable" P( ■ ) is often a POVM; a 
typical situation is that Jf? is a subspace (e.g., the positive spectral subspace of the 
free Hamiltonian) of a larger Hilbert space containing also unphysical states, and 
P( ■ ) = p'p ( . ) V where P' is the projection j£§ -»• V is the embedding <-+ Jgg, 
and Pq( ' ) is a PVM (the configuration observable) acting on Mq. 

To establish the existence of a Markovian jump process with rates (J2J) we need the 
following joint assumption on H, P, and the initial state vector \l/o- 

Assumption A The Hamiltonian H , the POVM P and the state vector £ ^ 
satisfy the conditions 

(Al) For all t EM. and x & E, ty t and P(x)^ t belong to the domain of H . 
(A2) For all t , h 6 R wift t < t 1; 




dt ^ |<tt t |P(y)#P(a;)¥ t )| < oo. 

x,yeE 



For given P and P, Assumption 1X1 can also be understood as an assumption on ty , 
thus defining a set Q> = ^h,p ^ ^ of "good" state vectors for which the process is 
well-defined. This 3i is invariant under the time evolution but not necessarily a subspace 
of because assumption (A2) is not linear in \l/ t . The following proposition provides 
conditions on H under which Assumption [X] holds for all £ ^> so that S> = J^. 
(For general H we do not know how large <3l is, and whether it is dense, as would be 
physically desirable. We will not presuppose this but instead construct the process solely 
for initial state vectors \l/o 

Proposition 1 Assumption C4l holds for all £ ^ when either 

(a) H is bounded and E is finite, or 

(b) H is a Hilbert-S chmidt operator, i.e., tr H 2 < oo. 

The proof is postponed until Sectional Assumption (Al) implies that P(y)HP(x)^f t 
exists, and thus that 

at(y\x) is well defined whenever (^ t \P{x)^t) ^ 0. 

When (^ t \P(x)^t) = 0, we set a t (y\x) := oo for all y; thus, a t {y\x) is always defined as 
a [0, oo]-valued function. (When suitably reinterpreted, the numerator of (J2J still exists 
if P(x)^t and P{y)^t merely lie in the form domain, rather than the domain, of H. We 
will not pursue here this kind of greater generality.) 
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As was pointed out in the introduction, the rates a t (y\x) are constructed in such a 
way that the corresponding Markov process X t should have the quantum distribution 

7r t (a;) := (%\P(x)%) , xeE, (4) 

at any time t £ 1. In other words, the family (7Tt)tm should be equivariant, or an 
entrance law, for the process. Here is our main result stating that such a process does 
exist. 

Theorem 1 Suppose Assumption^ holds. Then there exists a right- continuous (time- 
inhomogenous) Markovian pure jump process (X t ) t£ ^ in E with transition rates (J2J) and 
such that, for each t, X t has distribution n t . The process is unique in distribution. 



3 The construction 

We fix some starting time t$ 6 R and construct the process first on the time interval 
[t , oo[. We also introduce an auxiliary "cemetery" configuration A in order to deal with 
the possibility that the process explodes or runs into a node. In the next section we will 
show that this does in fact not occur. We write 

N := {(t, x) E R x E : ir t (x) = 0} (5) 

for the node-set of all exceptional times and positions for which the transition rates (J2J) 
are infinite. Likewise, 

Et := {x e E : 7r t (x) > 0} (6) 
is the set of all admissible positions at time t G R. Finally, for (t, x) £ M we let 

e t>x :=mf{s>t:{s,x)eN} (7) 

be the first time instant after t at which x becomes a node; here we set inf := oo. Let 
us start with a technical lemma; its proof follows later in this section. Formula (jSJ) relies 
on our convention h — 2. 

Lemma 1 For every x e E, the mapping t i— ► ir t (x) is differentiable with locally inte- 
grable derivative 

7Tt(x)=1m(* t \P(x)H%). (8) 

In particular, the function tt.(x) is locally absolutely continuous. Also, the jump rates 
at(y\x) depend measurably on t with values in [0, oo], and the total jump rate 

lx {t) (9) 

y&E 

is finite whenever (t, x) £ M . 
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The process (X t ) t > to will be constructed on the enlarged position space E U {A} by 
means of a suitable sequence of random jump times T n and jump destinations Z n . To 
achieve this we need two key quantities: the distribution fj, tiX of the holding time in 
x G E (i.e., the random waiting time before the next jump) after a given time t, and 
the distribution p tjX of the the jump destination at the jump time. Our assumption that 
the process (X t ) t >t should have the transition rates (J2J) simply means that fi t ,x should 
be the distribution with "failure rate function" (or "hazard rate function") 7 X ; cf. e.g. 
[231 PP- 276 ff., 577]. That is, for any (t,x) Af we let fi ttX be the unique probability 
measure on ]t, oo] with "survival probabilities" 

/x*, x ([m, oo]) = e~ r *'* (u) for all u > t, (10) 

where 

^ x {s)ds; (11) 

in (|TIH) and below we set e~°° = 0. (Note that Tf jX is left-continuous by the monotone 
convergence theorem, so that there exists indeed a unique probability measure fi t ,x 
having e~ Tt ' x as right-sided distribution function.) In particular, fj, tx ({oa}) > if and 
only if r t)a .(oo) < oo; thus, in this case there is a non-zero probability for the process to 
be frozen in x. If t = oo or x =A we let \i t ,x = ^oo be the Dirac measure at +oo. The 
following lemma collects the essential properties of n t>x . 

Lemma 2 Suppose (t, x) M . Then the following statements hold: 

(a) On ]t, 9t jX [, fit,x has the density function , y x e~ Vt ' x . 

(b) If 9^ < oo then fi t ,x([°t,x, oo]) = 0. 

(c) /i M (0 < j x < oo) = 1. 

(d) For any u e]*,^, ^(JttjOo]) > and fj, n>x = /j, tjX ( - \ )u, oo]). 

The proof will be given later in this section. It follows readily from (a) that if we 
take fi t , x as the the distribution of the holding time at x then the jump rate is indeed 
j x , as intended. Assertion (b) states that the process cannot run into a node by sitting 
on an x until it becomes a node: right before x becomes a node, the rate 7 X grows so 
fast that the process has probability 1 to jump away. In particular, the unboundedness 
of the jump rates (even for bounded H, even for Hilbert-Schmidt H) favours the global 
existence rather than preventing it. Statement (d) expresses a loss-of- memory property 
which is responsible for the Markov property of the process. 

As for the distribution of the jump destinations, we obviously have to define 

Pt,x(v) = °t{y\x)hx{t) if < 7 x (t) < oo . (12) 

Otherwise we set p t)X = 8 A , the Dirac measure at A. The next lemma states that p t>x is 
supported on the set E t of non-nodes defined in (0). 
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Lemma 3 p tiX (E t ) = 1 whenever < j x (t) < oo. 

With these ingredients we are now ready to construct the process (X t )t>t on EU{A}. 
Let (T n , Z n ) n >Q be a sequence of random variables with the following properties. Let 
T := to and Z G E to be a random variable with distribution 7T to . Then, for any n > 0, 
let (T n+ i, Z n+ i) have the conditional distribution 

P(T n+ i G dt, Z n+1 = y \T , Z ,..., T n , Z n ) = fM Tn ,z n (dt) p t ,z n (y) • (13) 

The existence of such a sequence (T n , Z n ) n > on a suitable probability space (f2 to , JF 4o , P to ) 
follows from the Ionescu-Tulcea theorem Theorem 5.17]. Moreover, Lemmas 121 and El 
imply that T n+ i < 9t„,z„ and Z n G Er n almost surely for all n. We also have T n < T n+ i 
as long as T n < oo. So we define 

X t = Z n when T n <t < T n+ i, and X t =A for £ > £ = supT n . (14) 

n 

It is then clear that {X t )t>t ls right- continuous, and (t,X t ) £ Af for all t G [to,([ with 
probability 1. In the next section we will show that in fact ( = oo almost surely. 

We now turn to the proofs of the lemmas above. Recall our convention that h = 2. 

Proof of LemmaUk Since \&t belongs to the domain of H by Assumption (Al), the Jff- 
valued mapping £ i— > is differentiable with derivative d^ t /dt = —^H^ t 22, p. 265]. 
Hence 

(7T t+s (x) - 7T t (x))/ S = (% +s \P(x)(% +s - %)/ 8 ) + ~ %)/s\P( X )%) 

converges, as s — > 0, to 

n t (x) := ~ (%\P(x)H%) + (H%\P(x)%) = Im (%\P(x)H* t ) . 

As a limit of the continuous difference ratios, t i— > "kt(x) is measurable. Moreover, using 
Q we can write 

\kt{x)\ < \{%\P(x)H%)\ = \(HP(x)%\%)\ 

= \j2(HP(x)^ t \P(y)^t}\ < Y^\(*t\P(x)HP(y)V t )\ . 

yGE y&E 

Together with Assumption (A2), it follows that 7Tt{x) is locally integrable. In particular, 
1 1— > 7Tt(x) is locally absolutely continuous and an integral function of 1 1— > 7Tt(x); see jUH 
Theorem 6.3.10] or [23 Theorems 8.21 and 8.17]. 

Concerning the measurability of the jump rates a t (y\x), it is sufficient to show that 
(^f t \P(y)HP(x)^>t) depends measurably on t. (This is because ir.(x) is continuous and 
the ratio of nonnegative measurable functions is measurable.) To this end, we introduce 
the cutoff function f n (a) := (a A n) V (— n) and observe that, for every t, 

(%\P(y)f n (H)P(x)%) - (%\P(y)HP(x)%) 
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as n — > oo. Hence t \— > (^ r t |P(|/)iifP(a;)^ r t ) is a pointwise limit of continuous functions 
and thereby measurable. In particular, the total jump rate j x is measurable. For 
(t, x) ^ Af we have 

7*W < ^|(^|P(y)^P(x)vI/ t )|/7r t (x) . 

The last sum is finite because, due to (j3J), the series ^2 y (^ t \P(y)HP(x)^/ t ) converges 
to (^/ t \HP(x)^/t) in every ordering, and is therefore absolutely convergent. □ 

Before proving Lemma El we establish the following result, a key fact for showing 
that the process never runs into a node. Recall the definitions (0) and fUJ) . 

Lemma 4 Suppose (t,x) ^ A/". Then T t , x (u) < 00 if t < u < 9 tiX , while T t , x (9t, x ) = 00 
if9 t , x < 00. 

Proof: Consider first the case t < u < 9 t)X . Since n.{x) is continuous and positive on 
[t,u], it stays bounded away from zero on this interval. On the other hand, we have 

dsY^\(^s\P(y)HP(x)^ s )\, 

and the last integral is finite due to Assumption (A2). This proves the first assertion. 
Consider now the case 9 tiX < 00. Since af > in general, we have for all 

t < s < 9 t)X 

lx (s) > [lmJ2(^s\P(y)HP(x)^ s )] + /tt s (x) . 
y 

In view of (J3J) and Lemma [H the last expression is equal to 

[lm(* s \HP(x)V s )] + /7r s (x) = [-n s (x)] + /7i s (x). 
Since always a + > a, we arrive at the key inequality 

7*(«) > -^-l0g7T s (x) . 

as 

The last derivative is integrable over any interval [t, u] with t < u < 9t, x because 
7T s (x) is bounded away from zero on such an interval and 7r s (x) is locally integrable 
by Lemma ^ By the general fundamental theorem of calculus as in [TUl Theorem 
6.3.10] or [251 Theorem 8.21], it follows that 

f u f u d 

J J x (s)ds>-J — log7T s (x) ds = log7T t (x) - log7T n (x). 

Letting u f 9t )X and using the continuity of tt u {x) we arrive at the second statement of 
the lemma. □ 

We are now ready for the proof of Lemma El 
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Proof of Lemma HI' (a) Let t < u < 9 t x . Instead of using the fundamental theorem 
of calculus (which would be possible), we prefer to give here a direct argument which 
is based on Fubini's theorem. In view of Lemma El T t x is finite on [t,u]. Thus we can 
write, omitting the indices t, x, 

t*u ru /*oo 

/ 7(s) e~ r{s) ds = / ds'y(s) / dre~ r l {r ^< r} 
Jt Jt Jo 

/*oo i*u roc 

= / dre~ r ds'y(s) l{r( s )<r} = / dre~ r (r A T(u)) . 
Jo Jt Jo 

The last equality uses the fact that T is continuous and increasing. Since r A r(n) = 
r — [r — r(w)] + , the last integral coincides with 1 — e _r (") = fJLt,x(]t, u\), thus proving 
assertion (a). 

(b) This is immediate from (fTU|) and Lemma 0] 

(c) This comes from statements (a) and (b) together with Lemma ^ 

(d) Let t < u < 9t )X . Since Y tyX {u) < oo by Lemma IH Equation (p"0|) shows that 
(H )X (]u, oo]) > 0. Moreover, for v > u we have 

^(Koo] |Koo]) = e - r *.-M+ r *.-(«) = e" r --W = av«(K«3]) 

by Equation This proves the final statement. □ 

We conclude this section with the proof of Lemma El 

Proof of Lemma\^i We only have to to show that o~ t (y\x) = whenever ir t (y) = 0. 
But since ||P(y) 1/2 ^|| 2 = n t (y), we then have P(y) 1/2 ^ t = 0. Hence P(y)^ t = and 
therefore (%\P(y)HP(x)^ t ) = (P{y)^t\HP{x)^ t ) = 0, which gives the result. □ 



4 Non-explosion 

In the last section we have constructed a process (X t )t>t that stays in the configuration 
space E until some possibly finite explosion time ( = sup n T n , at which it jumps into 
the cemetery A. We will now show that ( is in fact almost surely infinite. To this end 
we consider the random number 

S(t) := #{n > 1 : t < T n < t} E Z+ U {oo} (15) 

of jumps during the time interval }to,t] for any t > to- We want to show that S(t) has 
finite expectation. To this end we start from the following formula. 

Lemma 5 For all t > t , 

E t0 S(t) = I dsJ2 F t {X s = x) a s {y\x) . 

x,y&E 
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To estimate the last expression we will show: 

Lemma 6 P to (X i = x) < 7r 4 (x) for all x G E and t > t . 

In other words, though the rates are constructed in such a way that the process 
should follow the equivariant distribution n t , we cannot exclude a priori that some 
mass is lost at the cemetery A. Combining these two lemmas we obtain 

E to S(t)< / ds ^2 7i s (x)a s (y\x) 

x,y£E 

ds [lm(^ s \P{y)HP(x)^ s )} + 

x,y£E 

< fdsJ2 \ (*s\P(v)HP(x)* a )\, 

x,y£E 



n>0 n>0 

- r T„,Z„(s) 



and the last expression is finite by Assumption (A2). Hence S(t) < oo almost surely, 
and thereby £ > t almost surely. As t was arbitrary, we conclude that Q = oo almost 
surely, as we wanted to show. We now turn to the proofs of the two lemmas above. 

Proof of Lemma [3' Using Equation (|13|) and Lemma 121 we can write 

Eto S(t) = P ^o < T n+l <t) = ^(^0 {h < T n+1 <t\T k ,Z k :k< 

n>0 

= ^2 ds E ( 1 {T„< S } lz n (s) P t0 (T n+1 > s I T k , Z k : k < n) 

n>0 ^0 

= I dsJ2 r r^( S ) E {^2 1 {T n <t<T n+1 ,Z n =x] 
x£E n>0 

= [ dsJ2^( s )^t (X s = x). 

Jtn 



1 <s<B Tn , Zn }^z n { s ) e 



x£E 



Together with Q the lemma follows. □ 
For the proof of Lemma El we consider the integral equation 



p t (x) = 7T t0 {x) e" ri o^W + J2[ds p s {y) a s {x\y) e" rs ^ (t) , (16) 

y eE J *° 



t > t , x G E, for a time-dependent subprobability measure p t on E. Lemma El follows 
directly from the next two results. 
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Lemma 7 The mapping (t, x) i— > F to (X t = x) is the minimal solution of (JTfij) . 
Lemma 8 The mapping (t,x) i— ► ^(x) zs a solution of /or arbitrary to- 
Proof of Lemma^J\ For any x E E and t > to we can write 

P t0 (X t = x) = Mt, x) with A n (t, x) := P t0 (T n < t < T n+1 , Z n = x). 

n>0 

It follows from (JTUJ) that 

A (t,x) =7r to (x)e- r *o^(*) (17) 

and, for n > 1, 

A n (t,x)= Yl /•••/ 

> x n-l£E t <ti<—<t n <t 
X IPto (^1 ^ ^1) • ■ • j ?n 6 C?tn, T n+ i > t, = Xq, . • . , Z n = x r 



^ J " j dh---dt n 

.,X n -l&E to<t!<-<t n <t 

n 

( x o) {j\e~ VuM - l{h) VtM\ x i-i) ) e~ Vtn ' x{t) 



X , 

i=l 



where x n := x. In particular, separating the summation over x n _i and the integration 



over t n we find that 



A n {t,x) = J2 [ ds A n ^ 1 (s,y)a s (x\y)e- 1 



This shows that Pt (X t = x) satisfies (JTHJ). 

Now let pt(x) be an arbitrary (nonnegative) solution of (j!6|) . An (iV— l)-fold iteration 
of ((inj) then leads to the equation 



N-l 



Pt( x ) = A ^{t, x) + R N (t, 



n=0 



with A n (t, x) defined by (|T7|) and (|TH|). and the remainder term 
R N (t,x) = ^ J J dt\---dt N 

xa,...,x N -iEE to<tl< ... <tN < t 
N-l 



x Pti(^o) (JJ ^(x^x^Oe r W*»+i)j 



(T^IX X^-i) e 



-rv*(t) 
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(Compared with A N (t,x), _R/v(t, x) involves p tl rather than p to = ir to , and the ex's and 
e~ r 's run in a different order.) Since -Rjv(t, %) > 0, we see that pt(x) exceeds each partial 
sum of the infinite series constituting F to (X t = x). This proves Lemma [7| □ 

Proof of Lemma\^ We start from the observation that, by (|SJ), (j2J), © an d the self- 
adjointness of H and P(x), 

7r t (x)=lm (HP(x)%\%) = J2 lm (HP(x)%\P(y)%) 

y&E 

= ^2\*t{y) °t(x\y) - (T t (y\x)j 

y&E 
y&E 

This means that the integral equation (JTfiJl for 7t t (x) takes the form 

ir t (x) -Tr t0 (x)e- Tt °>*® = [ ds(7r s (x) + TT s (x) lx (s))e~ r ^ (t \ (19) 

Jt 

To establish this equation we write for brevity f(s) = tt s (x) and g(s) = e~ rs ' x ^ and 
distinguish two cases. 

Case 1: f > on [t ,t\; that is, x is never a node on this interval. Then, by 
Lemma |H 7 X is integrable over [to,t], whence s i— > T StX (t) is absolutely continuous with 
derivative — j x . Since the exponential function is Lipschitz on ] — oo, 0], it follows that g 
is absolutely continuous with derivative g — "f x g Lebesgue-almost-everywhere; see (TU1 
Corollary 6.3.7] or [251 Theorem 8.17]. Equation (flT)|) is thus equivalent to the partial 
integration formula 

f(t)g(t) - f(t )g(t ) = f {}{s)g{s) + f{s)g{s))ds 

which holds according to Corollary 6.3.8 of [ID] . 

Case 2: f(s) = for some s £ [to,t); that is, x is a node at some time s. By the 
continuity of /, there exists then a largest such s in [to,t], say 0. Suppose first that 
9 = to- We can then apply Case 1 to each subinterval of [to,t], which yields f)19jl 
with t* in place of t . Let J(t*) be the corresponding integral on the right-hand side. 
Since the integrand is nonnegative, we can use the monotone convergence theorem to 
conclude that I(t*) t (to) as t* i to- On the other hand, f(t*)g(t*) — > = f(t )g(t ) as 
t* I t because / is continuous and < g < 1. This proves (jTUjl in the case 9 = t . 

If > to, we observe that r SiX (t) = exo for all s < 9. Indeed, we even have T StX (9) = 
oo. This is evident when ]s,9[ consists only of node-times because then 7 X is infinite on 
this interval; otherwise it follows from the second statement of Lemma applied to the 
segment from a non-node-time between t and 9 to the next node-time. Consequently, 
the left-hand side of (J19)) is equal to f(t), while the integrand on the right-hand side 
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vanishes on [t Q , 9[. This means that we have to establish ()19J) with t replaced by 9. But 
this is trivial when 9 = t because then both sides vanish, and otherwise follows from the 
previous paragraph. □ 



It is now easy to complete the proof of the theorem. 

Proof of Theorem 0- As we have shown above, for any to £ R there exists a right- 
continuous pure jump process (X t )t>t on a suitable probability space (Q to , .F to , P to ). 
Since ( = oo almost surely, this process avoids the cemetery A and thus takes values 
in E. Hence XLee = x) = 1 for all t > t - Lemma therefore implies that 

F to (X t = x) = Tr t (x) for all x G E and t > t . In particular, if E t is given by © then 
X t G E t for all t >t with probability 1. 

We also note that (X t )t>t is Markovian; its transition matrix from time s to time t 
given by 

P s , t (x,-)=F s (X t = -\X s = x) 

when x G E s , and arbitrary otherwise. This follows directly from the construction to- 
gether with Lemma Efd). In particular, the distribution Pt of (X t ) t > to on the Skorohod 
space D([to, oo[, E) of all cadlag 1 paths from [to,oo[ to E is uniquely determined, and 
the family (Pt ) toS ]R is consistent. Kolmogorov's extension theorem PHI Theorem 5.16] 
therefore provides us with a probability measure P on E R which extends all distributions 
Pt and is therefore concentrated on D(M., E), the space of all cadlag paths on R. Under 
P, the canonical coordinate process constitutes the global Markov jump process with 
the desired properties. □ 



5 Proof of Proposition U 

First we consider ). Since H is bounded, assumption (Al) holds trivially. The 

boundedness of H also implies that the expression (ty t \P(x)HP(y)ty t ) is (well defined 
and) a continuous function of t for every x and y. As E is finite, the integrand in 
Assumption (A2) is continuous and therefore locally integrable. 

Turning to case (b), we observe first that assumption (Al) is again trivially satisfied 
because Hilbert-Schmidt operators are bounded. Assumption (A2) will follow from the 
inequality 

^2 \ m p (x)HP(y)V) \ < 11*11 Vtr H 2 WeJf (20) 

x,y£E 

which we prove now. 

We start with a general remark. Let J? be a countable index set and Aj and Bi, 
i G J^, any Hilbert-Schmidt operators with (possibly different) adjoints A* resp. B*; 
i.e., we have tr A* Ai < oo and similarly for B^. The Cauchy-Schwarz inequality then 
asserts that 

\trA*B t \ < QTtr4*^) 1/2 (^tri^) 172 (21) 
1 continues a droite avec des limites a gauche = right-continuous with left limits. 
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whenever both terms on the right hand side are finite. (Note that we can put the modulus 

sign inside of the sum because we can replace A4 by ZiAi with 2, = (tr A*Bi)/\tv A*Bi\ 

whenever tr A* Bi 7^ 0.) 

To obtain (J1IJ) from fl23J, we set J = E x E, A x>y = P{x) 1 / 2 P^,P{y) 1 ' 2 with 
= the projection to C#, and B x>y = P{x) 1 l 2 HP{y) 1 l' 2 . Then tr A* xy B xw = 

(^\P(x)HP(y)ty). To see that A x>y is a Hilbert-Schmidt operator, we note that 

tvA* x>y A x>y = ti(p{y) l/2 P^P{x)P^P{y) 1/2 ) = (*|P(a;)tf)<tf|P(y)tt) < 00. 
It follows further from Q that 

^tr^A,,, = ^{*\P(x)*){*\P(y)V) = II^H 4 . 

x,y x,y 

Next we show that B x>y is a Hilbert-Schmidt operator. Note that < P(x) < I 
since / - P(x) = P(E \ {x}) > 0. This implies that < ($|P(x)$) < ($|$) for all 
$ € J^. Setting $ := C0 n for any Hilbert-Schmidt operator C and an orthonormal 
basis {(fi n : n G N} of ^f 7 we find 

^(0 n |C*P(x)C0 n > < ^(0„|C*C0 n > 

nGN nGN 

and thus 

tr C*P{x)C < trC*C. (22) 

That is, if C is a Hilbert-Schmidt operator then so is P{x) 1 ^ 2 C\ and so is CP(x) 1 ^ 2 = 
(P(x) 1 ^ 2 C*)* . As a consequence, P^ is a Hilbert-Schmidt operator. 
Finally, we need to show that 

trBl y B x , y <trH 2 . 

x,y£E 

For every finite subset P C P we have, using the linearity of the trace and its invariance 
under cyclic permutations, 

tTB *x,y B x, y = trHP (x)HP(y) = tr HP(F)HP(F) 

x,y€F x,y£F 

= ti(P{Fyi 2 HP{F) l l 2 Y \P{F) l ' 2 HP{F) 1 ' 2 ) < trH 2 . 

The last inequality comes from the fact that, according to (}22|) . the Hilbert-Schmidt 
norm ||C||#s = \/tr C*C of an operator C can only decrease when C is multiplied, from 
the left or from the right, by P 1 / 2 where < P < I. Taking the supremum over all 
finite subsets F and combining all inequalities above we arrive at (}2T)j) . 
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